Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Spark] Pass table identifiers/table catalogs to DeltaLog API call sites #3788

Closed

Conversation

ctringdb
Copy link
Contributor

Which Delta project/connector is this regarding?

  • Spark
  • Standalone
  • Flink
  • Kernel
  • Other (fill in here)

Description

  • Added forTable(SparkSession, CatalogTable, Map[String, String])
  • Added forTableWithSnapshot(SparkSession, CatalogTable, Map[String, String])
  • Modified withFreshSnapshot to take in a table identifier.
  • Passed table identifier or table catalog to call sites of DeltaLog API so that the table identifier becomes available and eventually passed to the commit coordinator.

How was this patch tested?

unit tests

Does this PR introduce any user-facing changes?

No

@ctringdb ctringdb changed the title Pass table identifiers/table catalogs to DeltaLog API call sites [Spark] Pass table identifiers/table catalogs to DeltaLog API call sites Oct 22, 2024
@ctringdb ctringdb closed this Oct 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant